Learning Social Affordance for Human-Robot Interaction

نویسندگان

  • Tianmin Shu
  • Michael S. Ryoo
  • Song-Chun Zhu
چکیده

In this paper, we present an approach for robot learning of social affordance from human activity videos. We consider the problem in the context of human-robot interaction: Our approach learns structural representations of human-human (and human-object-human) interactions, describing how body-parts of each agent move with respect to each other and what spatial relations they should maintain to complete each sub-event (i.e., sub-goal). This enables the robot to infer its own movement in reaction to the human body motion, allowing it to naturally replicate such interactions. We introduce the representation of social affordance and propose a generative model for its weakly supervised learning from human demonstration videos. Our approach discovers critical steps (i.e., latent sub-events) in an interaction and the typical motion associated with them, learning what body-parts should be involved and how. The experimental results demonstrate that our Markov Chain Monte Carlo (MCMC) based learning algorithm automatically discovers semantically meaningful social affordance from RGB-D videos, which allows us to generate appropriate full body motion for an agent.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning Interactive Affordance for Human-Robot Interaction

In this paper, we present an approach for robot learning of social affordance from human activity videos. We consider the problem in the context of human-robot interaction: Our approach learns structural representations of human-human (and human-object-human) interactions, describing how body-parts of each agent move with respect to each other and what spatial relations they should maintain to ...

متن کامل

A Code of Ethics for the Human-Robot Interaction Profession

As robots transition into human social environments, a new range of technical, ethical, and legal challenges are arising. This paper discusses the unique ethical challenges facing HRI practitioners designing robots for these spaces, and proposes a code of ethics for the profession. We argue that the affordance of all rights and protections ordinarily assumed in human-human interactions apply to...

متن کامل

Object-object interaction affordance learning

This paper presents a novel object–object affordance learning approach that enables intelligent robots to learn the interactive functionalities of objects from human demonstrations in everyday environments. Instead of considering a single object, we model the interactive motions between paired objects in a human–object–objectway. The innate interaction-affordance knowledge of the paired objects...

متن کامل

Unsupervised Learning of Basic Object Affordances from Object Properties

Affordance learning has, in recent years, been generating heightened interest in both the cognitive vision and developmental robotics communities. In this paper we describe the development of a system that uses a robotic arm to interact with household objects on a table surface while observing the interactions using camera systems. Various computer vision methods are used to derive, firstly, ob...

متن کامل

Soziale Roboter und soziale Räume: eine Affordanz-basierte Konzeption zum rücksichtsvollen Handeln

If autonomous agents like humans and robots act in physical space, several types of conflicts can occur that result from the fact that actions occupy space. To avoid such conflicts, social robots must have the capacity to consider the actions taken by other robots and by humans. This thesis proposes a conceptual framework which can be used to specify knowledge about spatial needs of activities ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016